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Abstract 

In this work we propose the construction of two-channel wavelet filterbanks for analyzing functions 
defined on the vertices of any arbitrary finite weighted undirected graph. These graph based functions 
are referred to as graph-signals as we build a framework in which many concepts from the classical 
signal processing domain, such as Fourier decomposition, signal filtering and downsampling can be 
extended to graph domain. Especially, we observe a spectral folding phenomenon in bipartite graphs 
which occurs during downsampling of these graphs and produces aliasing in graph signals. This property 
of bipartite graphs, allows us to design critically sampled two-channel filterbanks, and we propose 
quadrature mirror filters (referred to as graph-QMF) for bipartite graph which cancel aliasing and lead 
to perfect reconstruction. For arbitrary graphs we present a bipartite subgraph decomposition which 
produces an edge-disjoint collection of bipartite subgraphs. Graph-QMFs are then constructed on each 
bipartite subgraph leading to "multi-dimensional" separable wavelet filterbanks on graphs. Our proposed 
filterbanks are critically sampled and we state necessary and sufficient conditions for orthogonality, 
aliasing cancellation and perfect reconstruction. The filterbanks are realized by Chebychev polynomial 
approximations. 
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EDICS Category: DSP-WAVL, DSP-BANK, DSP-MULT, DSP-APPL, MLT 

Sunil K. Narang is with the Signal & Image Processing Institute, Ming Hsieh Department of Electrical Engineering, University 
of Southern California, Los Angeles, California, USA 90089 email: narang.sunil@gmail.com. 

Antonio Ortega is with the Signal & Image Processing Institute, Ming Hsieh Department of Electrical Engineering, University 
of Southern California, Los Angeles, California, USA 90089 email: antonio.ortega@sipi.usc.edu. 

This work was supported in part by NSF under grant CCF-1018977. 



December 5, 2011 



DRAFT 



2 



I. Introduction 

A. Motivation 

Graphs provide a very flexible model for representing data in many domains. Many networks such 
as biological networks 01, social networks EJ, 131 and sensor networks llH, ||5l etc. have a natural 
interpretation in terms of finite graphs with vertices as data-sources and links established based on 
connectivity, similarity, ties etc. The data on these graphs can be visualized as a finite collection of 
samples termed as graph-signals. For example, graphical models can be used to represent irregularly 
sampled datasets in Euclidean spaces such as regular grids with missing samples. In many machine 
learning applications multi-dimensional datasets can be represented as point-clouds of vectors and links are 
established between data sources based on the distance between their feature- vectors. In computer vision, 
meshes are polygon graphs in 2D/3D space and the attributes of the sampled points (coordinates, intensity 
etc) constitute the graph-signals. The graph-signal formulation can also be used to solve systems of partial 
differential equations using finite element analysis (grid based solution). The sizes (number of nodes) of 
the graphs in these applications can be very large, which present computational and technical challenges 
for the purpose of storage, analysis etc. In some other applications such as wireless sensor-networks, the 
data-exchanges between far-off nodes can be expensive (bandwidth, latency, energy constraints issues). 
Therefore, instead of operating on the original graph, it would be desirable to find and operate on smaller 
graphs with fewer nodes and data representing a smootl£] approximation of the original data. Moreover, 
such systems need to employ localized operations which could be computed at each node by using 
data from a small neighborhood of nodes around it. Multi-channel wavelet filterbanks, widely used as a 
signal processing tool for the sparse representation of signals, possess both these features (i.e. smooth 
approximations and localized operations). For example, a two channel wavelet transform splits the sample 
space into an approximation subspace which contains a smoother (coarser) version of the original signal 
and a detail subspace containing additional details required to perfectly reconstruct the original signal. 
A discussion of the construction and analysis of wavelet filterbanks for regular signals can be found 
in standard textbooks such as @. While wavelet transform-based techniques would seem well suited 
to provide efficient local analysis, a major obstacle to their application to graphs is that these, unlike 
images, are not regularly structured. For graphs traditional notions of dimensions along which to filter 
the data do not hold. 

'more generally, it could be any sparse approximation of the original data. 
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Researchers have recently focused on developing localized transforms specifically for data defined 
on graphs. Crovella and Kolaczyk ^ designed wavelet like functions on graphs which are localized 
in space and time. These graph functions Tpj^k are composed of either shifts or dilations of a single 
generating function t/j. Wang and Ramchandran |5| proposed graph dependent basis functions for sensor 
network graphs, which implement an invertible 2-channel like filter-bank. There exists a natural spectral 
interpretation of graph-signals in terms of eigen-functions and eigen-values of graph Laplacian matrix 
L. Maggioni and Coifman Q introduced "diffusion wavelets" as the localized basis functions of the 
eigenspaces of the dyadic powers of a diffusion operator. Hammond et. al. [8] construct a class of 
wavelet operators in the graph spectral domain, i.e., the space of eigenfunctions of the graph Laplacian 
matrix L. These eigenfunctions provide a spectral decomposition for data on a graph similar to the Fourier 
transform for standard signals. A common drawback of all of these filterbank designs is that they are 
not critically sampled : the output of the transform is not downsampled and there is oversampling by a 
factor equal to the number of channels in the filterbank. Unlike classical wavelet transforms which have 
well-understood downsampling/upsampling operations, there is no obvious way in graphs to downsample 
nodes in a regular manner, since the neighboring nodes vary in number. Lifting based wavelet transforms 
have been proposed in lITOl for graphs in Euclidean Space and in our previous work for trees in 
iin and for general graphs in |[T2l . These transforms are critically sampled and invertible by construction. 
However the design requires splitting the vertex set of the graph into two disjoint sets and the transform 
is computed only on the links between nodes in different sets. Thus links between nodes in same set are 
not utilized by the transform. 

Our contribution in this paper is to introduce a theory behind sampling operations on graphs, which 
leads us to the design of critically-sampled wavelet-filterbanks on graphs. We describe a downsample 
then upsample (DU) operation on graphs in which a set of nodes in the graph are first downsampled 
(removed) and then upsampled (replaced) by inserting zeros. This work stems from our recent results 
in ifTSl . where we showed that downsampling for graph-signals defined on k-regular bipartite graphs is 
governed by a Nyquist-like theorem. In this paper, we extend the results presented in |[T3l to all undirected 
bipartite graphs and show that in these graphs, the DU operations lead to a spectral decomposition of 
the graph-signal where spectral coefficients are reproduced at mirror graph-frequencies around a central 
frequency. This is a phenomenon we term as spectrum folding in graphs as it is analogous to the frequency- 
folding or "aliasing" effect for regular one-dimensional signals. We utilize this property to propose two- 
channel filterbanks on bipartite graphs which are critically sampled and provide necessary and sufficient 
conditions for aliasing cancellation, perfect-reconstruction and orthogonality in these filterbanks. As a 
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practical solution we propose a graph-quadrature mirror filterbank (referred to as graph-QMF) design 
for bipartite graphs which has all the above mentioned properties. However, the exact realizations of 
the graph-QMF filters do not have well-localized support on the graph and therefore we implement 
polynomial approximations of these filters which are locally supported around each node (at the cost 
of small reconstruction error and loss of orthogonality). For arbitrary graphs, we formulate a bipartite 
subgraph decomposition problem well known to the graph-theory community. The decomposition provides 
us an edge-disjoint collection of K bipartite subgraphs, each with the same vertex set V and whose 
union is the original graph. Each of these subgraphs is then used as a separate "dimension" to filter and 
downsample leading to a iC-dimensional separable wavelet filterbank design. To the best of our knowledge 
no such invertible and critically sampled two-channel filter-bank designs have been proposed for arbitrary 
graphs before. The outline for the rest of the paper is as follows: we describe the basic framework to 
understand graph-based transforms in Section In] In this section we also describe and evaluate some of 



the existing work on wavelet-like transforms on graph. In Section III we propose our solution and in 



Section IV we demonstrate the utility of proposed filterbanks by conducting some experiments. Finally, 



in Section |Vj we conclude and describe our future work. 

II. Preliminaries 

We use the common convention of representing matrices and vectors with bold letters, sets with 
calligraphic capital letters and scalars with normal letters. A graph can be denoted as G = (V,£) with 
vertices (or nodes) in set V and links (or edges) as tuples in E. We only consider undirected graphs 
without self-loops in our work. The size of the graph N = \V\ is the number of nodes and geodesic 
distance metric is given as d{v,m). The j-hop neighborhood Mj^n = {v : d{v,n) < j} of node n 
is the set of all nodes which are at most j-hop distance away from node n. Algebraically, a graph can 
be represented with the node-node adjacency matrix A such that the element A{i,j) is the weight of 
the edge between node i and j (0 if no edge). The value di is the degree of node i, which is the sum 
of weights of all edges connected to node i, and D = diag{{di}) denotes the diagonal degree matrix 
whose i^^ diagonal entry is di. The Laplacian matrix of the graph is defined as L = D — A and has a 
normalized form £ = I — D^^^AD^^^, where I is the identity matrix. We denote < fi,f2 > as the 
inner-product between vectors fi and £2. 
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A. Spatial Representation of Graph Signals 

A graph signal is a real-valued scalar function / : V — )■ M defined on graph G = (V, E) such that f{v) 
is the sample value of function at vertex v G Vj^ On a finite graph, the graph-signal can be viewed as a 
sequence or a vector f = [/(O), /(I), f{N)Y, where the order of arrangement of the samples in the 
vector is arbitrary and neighborhood (or nearness) information is provided separately by the adjacency 
matrix A. Graph-signals can, for example, be a set of measured values by sensor network nodes 13 or 
traffic measurement samples on the edges of an Internet graph ||2l or information about the actors in a 
social network. Further, a graph based transform is defined as a linear transform T : — )• applied 
to the A^-node graph-signal space, such that the operation at each node n is a linear combination of the 
value of the graph-signal /(n) at the node n and the values f{m) on nearby nodes m G A/'j.n, i.e., 

y{n) = T{n,n)f{n) + ^ T{n,m)f{m) (1) 

In analogy to the 1-D regular case, we would sometimes refer to graph-transforms as graph-filters and the 
elements T(n, m) for m = 1, 2, ...N as the filter coefficients at the n*'* node. A graph transform is said 
to be strictly j-hop localized in the spatial domain of the graph if the filter coefficients T(n, m) are zero 
beyond the j-hop neighborhood of each node n. Note that spatial localization can also be applied in a 
weaker sense in which filter coefficients T{n, m) decay sharply in magnitude beyond j'-hop neighborhood 
of node n. 

B. Spectral Representation of Graph Signals 

The Laplacians L and C are both symmetric positive semidefinite matrices and therefore, from the 
spectral projection theorem, there exists a real unitary matrix U which diagonalizes C, such that U*£U = 
A = diag{Ai} is a non- negative diagonal matrix. This leads to an eigenvalue decomposition of matrix 
C given as 

N 

£ = UAU* = J^AiUiut (2) 

i=l 

where the eigenvectors ui, U2, u^v, which are columns of U form a basis in and the corresponding 
eigenvalues (t{G) = {0 < Ai < A2... < Aat} represent N orthogonal eigen-spaces Vx^ with projection 
matrices UjU*. Thus, every graph- signal f e can be decomposed into a linear combination of 
eigenvectors Uj given as f = X]^=i ^'^^ been shown in |[T4l . |[T5l that the eigenvectors of 

^ The extension to complex or vector sample values f{v) is possible but is not considered in this work. 
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Laplacian matrix provide a harmonic analysis of graph signals which gives a Fourier-like interpretation. 
The eigenvectors act as the natural vibration modes of the graph, and the corresponding eigenvalues as 
the associated graph-frequencies. The spectrum (y{G) of a graph is defined as the set of eigen- values 
of its normalized Laplacian matrix and it is always a subset of closed set [0, 2] for any graph G. Any 
eigenvector u;^ is considered to be a low pass eigenvector if the magnitude of the corresponding eigenvalue 
A is small, i.e., close to 0. Similarly, an eigenvector is a high-pass eigenvector if its eigenvalue is large, 
i.e., close to the highest graph-frequency. The graph Fourier transform (GFT), denoted as f, is defined 
in 111 as the projections of a signal f on the graph G onto the eigenvectors of G, i.e., 

N 

f{X)=<nx , i>=Y,f{i)ux{i). (3) 

j=i 

Note that GFT is an energy preserving transform and a signal can be considered low-pass (or high- 
pass) if the energy |/(A)p of the GFT coefficients is mostly concentrated on the low-pass (or high-pass) 
eigenvectors. In case of eigenvalues with multiplicity greater than 1 (say Ai = A2 = A) the eigenvectors 
ui , U2 are unique up to a unitary transformation in the eigenspace Vx = Vx^ = Vx^ ■ In this case we can 
choose Aiuiu^ + A2U2U2 = APa where Pa is the projection matrix for eigenspace Vx- Note that for all 
symmetric matrices, the dimension of eigenspace Vx (geometric multipUcity) is equal to the multiplicity 
of eigenvalue A (algebraic multiplicity) and the spectral decomposition in ([2]l can be written as 

11= ^E"i"i= E ^p^- (4) 

Aeo-(G) Ai=A Aeo-(G) 

The eigenspace projection matrices are idempotent and P;^ and P^ are orthogonal if A and 7 are distinct 
eigenvalues of the Laplacian matrix, i.e., 

PaP-, = 5(A-7)Pa, (5) 
where (5(A) is the Kronecker delta function. 

C. Downsampling in Graphs 

We define the downsampling operation (3fj on the graph G = {V,E) as choosing a subset H C V such 
that all samples of the graph signal f, corresponding to indices not in H, are discarded. A subsequent 

'The mapping u„ — !> V associates the real numbers u„(i),i = {1, 2, A'^}, with the vertices V of G. The numbers u„{i) 
will be positive, negative or zero. The frequency interpretation of eigenvectors can thus be understood in terms of number of 
zero-crossings (pair of nodes with different signs) of eigenvector u„ on the graph G. For any finite graph the eigenvectors with 
large eigenvalues have more zero-crossings (hence high-frequency) than eigenvectors with small eigenvalues. These results are 
related to 'nodal domain theorems' and readers are directed to |16| for more details. 
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upsampling operation projects the downsampled signal back to original M'^ space by inserting zeros 
in place of discarded samples in H'^ = L. Given such a set H we define a downsampling function 
I3h e {-1,+1} given as 

f 1 if n G 

Mn) = I (6) 
[ -1 iin(^H 

and a diagonal downsampling matrix 3 = diag{(3H{n)}. The overall 'downsample then upsample'(i^^^) 
operation can then be algebraically represented as 

fdu{n) = lil+^H{n))f{n) (7) 



and in matrix form as 



frf„ = ^(I + J^„)f (8) 



Note that J^^ is a symmetric matrix such that J^^ = I (identity matrix). Since the graph-signal after 
DU operation also belongs to R^, it too has 
between the GFTs of f and idu is given as: 



DU operation also belongs to R^, it too has a OFT decomposition frf„ according to (pj). The relationship 



fdu{l) =< u/ , fdu >= ^(< uz , f> + <ui , JibJ >) (9) 

The inner-product < u; , J/3„f > can also be written as < J^^u^ , f >, which represents the projection 
of input signal f onto a deformed eigenvector J^^u^. We define this projection as a deformed spectral 
coefficient f'^(/) and ^ can be written as: 

hu{i) = \m+ < j/3«uz , f >) = ^(/(o + /^(o) (10) 

In case of bipartite graphs, the spectrum of the graph is symmetric and the deformed eigenvectors are 
also the eigenvectors of the same graph. This phenomenon, termed as spectral folding, forms the basis 
of our two-channel filterbank framework, and will be described in detail in Section Inil 



D. Two-Channel Filterbanks on Graph 

A two-channel wavelet filterbank on a graph provides a decomposition of any graph-signal into a 
lowpass (smooth) graph-signal and a highpass (detail) graph-signal component. The two channels of 
the filterbanks are characterized by the graph-filters {Hj, Gjjjgjo^i} and the downsampling operations 
(3jj and as shown in Figure [T] The transform Hq acts as a lowpass filter, i.e., it transfers the 
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contributions of the low-pass graph-frequencies which are below some cut-off and attenuates significantly 
the graph-frequencies which are above the cut-off. The highpass transform Hi does the opposite of a 
low-pass transform, i.e, it attenuates significantly, the graph-frequencies below some cut-off frequency. 
The filtering operations in each channel are followed by downsampling operations and which 
means that the nodes with membership in the set H store the output of highpass channel while the nodes 
in the set L store the output of lowpass channel. For critically sampled output we have: \H\ + \L\ = 
Using ([8]l, it is easy to see from Figure [T] that the output signals in the lowpass and highpass channels. 



analysis side 




synthesis side 



Go 




Fig. 1 : Block diagram of a two-channel wavelet filterbank on graph. 



after reconstruction are given as 



Go(I + J/3jHof 
Gi(I + J;3„)Hif, 



(11) 



respectively. The overall output f of the filterbank is the sum of outputs of the two channels, i.e., 
i = + in = Tf, where T is the overall transfer function of the filterbank given as: 



^Go(I + J/3JH0 + ^Gi(I + J^jHi 
-(GqHo + GiHi) + -(GoJ/3^Ho + GiJ/3^Hi] 



(12) 



where T^q is the transfer function of the filterbank without the DU operation and TaHas is another 
transform which arises primarily due to the downsampling in the two channels. For perfect reconstruction 



^ Note that in the regular signal domain the two most common patterns of critically sampled output are i) H — L = 
{0, 2, 4, ...}, where even set of nodes store the output of both channels and ii) L = {0, 2, 4, ...} and H = {1,3,5, ...} , where 
each node stores the output of only one of the channel. 
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T should be equal to identity which can be ensured by requiring T^q to be a scalar multiple of identity 
and Taiias = 0- Thus the two-channel filterbank on a graph provides distortion-free perfect reconstruction 
if 

GoJ/3i,Ho + GiJ/3^Hi = 

GoHo + GiHi = cl (13) 

In order to design perfect reconstruction filterbanks we need to determine a) how to design filtering 



operations Hj,Gj,i = {0, 1}, and b) the downsampling functions and Ph- In Section III we show 
that the spectral folding phenomenon in bipartite graphs leads to an aliasing interpretation of ( 13 1 and we 
design filterbanks which cancel aliasing and lead to perfect reconstruction of any graph-signal. Before 
explaining our approach, we briefly analyze and evaluate some of the existing graph based transforms, 
by representing them using the framework we just introduced. 

E. Existing Designs 

Existing designs of wavelet-like filterbanks on the graph can be divided into two types, namely, spatial 
and spectral designs. In order to understand these designs we introduce some additional notation.We define 
dMh,k to be an /i-hop neighborhood ring around node k (i.e., the set of all nodes which are exactly h 
hops away from node k), a j-hop adjacency matrix s.t. Aj{n,m) = 1 only if m E ■^j,n, a j-hop 
diagonal degree matrix with Dj{k,k) = \Mj^k\ s.t. dj^k = \-^j,k\ and a j-hop uniform Laplacian matrix 
Lj = Dj — Aj. Similarly we define a ring adjacency matrix dA^ such that dAj{n, m) = I only if m G 
dMj^n and corresponding ring degree matrix dY)h = diag{ddj^k} s.t. ddj^k = \dJ\fh,k\- 

1) Spatial Designs: Wang and Ramchandran [5| proposed spatially localized graph transforms for 
sensor network graphs with binary links, (i.e. links which have weight either or 1). The transforms 
proposed in ||5l either compute a weighted average given as 

y[n) = (1 - a+ ° )x{n) + V " x{m), (14) 

dj,k + 1 ^ djk + 1 

or a weighted difference given as 

y{n) = {l + h- ^ )x{n) - V , ^ (15) 
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in a j-hop neighborhood around each node in the graph. The corresponding transform matrices can be 
represented for a given j as 



T,- = I-a(I + D,)-iL,- 



Sj = I + 5(1 + Bj)-^L 



(16) 



This approach intuitively defines a two-channel wavelet filter-bank on the graph consisting of two types 



of linear filters: a) approximation filtersas given in (14 1 and b) detail filters as given in (15 1. However, 
these transforms are oversampled and produce output of the size twice that of the input. Further none of 
the transforms can be called a wavelet filter since both transforms have a non-zero DC response. 

Crovella and Kolaczyk 12] designed wavelet like transforms on graphs which are localized in space. 
They defined a collection of functions tpj^n : V — )• M, localized with respect to a range of scale/location 
indices {j,n), which at a minimum satisfy Xlmev ^i>"("^) ~ ^ ^ ^^^^ response). Each function 
ipj^n is constant within hop rings dJ\fh,n and can be written as: 



y(n) = aj^ox{n) + ^ ^ 



h=l meA^h,. 



x{m) 



(17) 



In matrix form the j-hop wavelet transform Tj can be written as: 



(18) 



Further, the constants aj^h satisfy Ylh=o 



0, which allows the wavelet filters to have zero DC 
response. . Though these transforms are local and provide a multi-scale summarized view of the graph, 
they do not have approximation filters and are not invertible in general. 

Lifting based wavelet transforms for graphs have been proposed in B, ifTlll . ifTOl and provide 
a natural way of constructing local two-channel critically sampled filter-banks on graph-signals. In this 
approach the vertex set is first partitioned into sets of even and odd nodes V = O U £. The odd nodes 
compute their prediction coefficients using their own data and data from their even neighbors followed 
by even nodes computing their update coefficients using their own data and prediction coefficient of their 
neighboring odd nodes. The equivalent transform in matrix-form can be written as: 

update predict 



^lift 










Do 


-P 


U 









If 



(19) 



where and D^- are diagonal matrices of size \0\ and \£\ respectively. Although the lifting scheme 
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can be applied to any arbitrary graph, the design is equivalent to simplification of the graph to a bipartite 
(2-colorable) graph, given that nodes of the same color/parity cannot use each other's data even if they 
are connected by an edge. This results in edge losses. 

2) Spectral Designs: Maggioni and Coifman [7] introduced "diffusion wavelets", a general theory for 
wavelet decompositions based on compressed representations of powers of a diffusion operator (such as 
Laplacian). Their construction interacts with the underlying graph or manifold space through repeated 
applications of a diffusion operator T, such as the graph Laplacian L. The localized basis functions at 
each resolution level are orthogonalized and downsampled appropriately to transform sets of orthonormal 
basis functions through a variation of the Gram-Schmidt orthonormalization (GSM) scheme. Although 
this local GSM method orthogonalizes the basis functions (filters) into well localized 'bump-functions' 
in the spatial domain, it does not provide guarantees on the size of the support of the filters it constructs. 
Further the diffusion wavelets form an over-complete basis and there is no simple way of representing 
the corresponding transform T. 

Hammond et al [8| defined spectral graph wavelet transforms that are determined by the choice of a 
kernel function g : IR+ — The kernel g{X) is a continuous bandpass function in spectral domain 
with g{0) = and lim;^_i.oo S'(A) = 0. The corresponding wavelet operator = g{C) = Ug(A)U* acts 
on a graph signal f by modulating each Fourier mode as 

N 

Tgi = ^g{Xk)f{k)uk (20) 

k=l 

The kernel can be scaled as g{tX) by a continuous scalar t. For spatial localization, the authors design 
filters by approximating the kernels g{X) with smooth polynomials functions. The approximate transform 
with polynomial kernel of degree k is given by = g{L) = X]f=o ^^'^ exactly A: -hop localized 
in space. By construction the spectral wavelet transforms have zero DC response, hence in order to 
stably represent the low frequency content of signal f a second class of kernel function h : — )■ 
is introduced which acts as a lowpass filter, and satisfies /i(0) > and lim;^_i>oo h{X) = 0. Thus a 
multi-channel wavelet transform can be constructed from the choice of a low pass kernel h{X) and J 
band-pass kernels {g{tiX), ...,g{tjX)} and it is been shown that the perfect reconstruction of the original 
signal is assured if the quantity G{X) = /i(A)^ + X]fc=i di'^i^Y > on the spectrum of C (i.e., at the 
eigenvalues of C). However, these transforms are overcomplete, for example, a J-scale decomposition of 
graph-signal of size A^ produces (J + 1)A^ transform coefficients. As a result, the transform is invertible 
only by the least square projection of the output signal onto a lower dimension subspace. 
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To conclude this section, Table hi presents a summary of existing methods and their properties. 



Method 


DC response 


Critical 
Sampling 


Perfect Re- 
construction 


Orthogonality 


Requires 
Graph Sim- 
plification 


Wang & Ramchan- 


non-zero 


No 


Yes 


No 


No 


dran |5] 












Crovella & 


zero 


No 


No 


No 


No 


Kolaczyk [2J 












Lifting Scheme HI 


zero for wavelet 
basis 


Yes 


Yes 


No 


Yes 


Diffusion Wavelets Q 


zero for wavelet 
basis 


No 


Yes 


Yes 


No 


Spectral Wavelets |8] 


zero for wavelet 
basis 


No 


Yes 


No 


No 


Proposed graph-QMF 


zero (when degree- 


Yes 


Yes 


Yes 


No 


filterbanks 


normalized) for 
wavelet basis 











TABLE L Evaluation of existing graph wavelet transforms. 



in. Proposed Solution 

Our proposed two-channel critically sampled graph wavelet filterbanks are shown in Figure [T] For 
DU operations we choose a specific downsampling pattern in which sets H and L provide a bipartition 
of the graph nodes i.e., H n L = (p and H U L = V). This implies that downsampling functions 
hin) = —finin) = fi{n) and the nodes in L store the output of the lowpass channel whereas the nodes 
in the complement set H store the output of the highpass channel. The overall output after filtering and 
downsampling operations in both channels is critically sampled. For designing wavelet filters on graphs 
we exploit similar concepts of spectral decomposition as in |8]. Because of this, it is useful to define 
analysis wavelet filters Hq and Hi in terms of spectral kernels /io(A) and /ii(A) respectively. Thus given 
the eigen-space decomposition of Laplacian matrix C as in (|4]), the analysis filters can be represented as 

Ho = /io(/:)= ^o(A)Pa 

Ae.(G) ^21) 
Hi = /ii(£)= /ii(A)Pa 

Ae(7(G) 

^Our proposed solutions can be perfect reconstruction and orthogonal without being local or can be local with approximate 
reconstruction. 
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Since the Laplacian matrix £ is real and symmetric, the filters designed in (21 1 are also real and 



symmetric. As described in Section II-D the spectral decomposition of the output of a DU operation 
with downsampling function (3 yields a set of original signal coefficients and a set of deformed signal 
coefficients which are generated by the projection of the original signal onto deformed eigenvectors. In 
what follows, we take the special case of bipartite graphs for which the DU operation on any eigenvector 
produces an alias eigenvector at a mirror eigenvalue, a phenomenon, which is analogous to the "aliasing" 
effect observed in DU operations in regular signal domain. This property of bipartite graphs, allows 
us to express the perfect reconstruction conditions for the two channel graph-filterbanks, as given in 



(13 1, in simple terms. Subsequently, we state necessary and sufficient conditions for a two-channel graph 
filter-bank, designed using spectral transforms, to provide aliasing-cancellation, perfect reconstruction 
and an orthogonal decomposition of any graph-signal and propose a solution similar to quadrature mirror 
filters (QMF) in regular signal domain which satisfies all of the above conditions. For arbitrary graphs, 
we formulate a bipartite subgraph decomposition problem that provides us with a disjoint collection of 
bipartite subgraphs whose union is G. A wavelet filterbank can be constructed on each of these subgraphs 
leading to a multi-dimensional separable wavelet filterbank on any arbitrary graph. Finally, we propose 
a multi-resolution implementation in which the proposed filterbanks can be recursively applied to the 
downsampled output coefficients of each channel. 

A. Downsampling in bipartite graphs 

A bipartite graph G = (L, H, E) is a graph whose vertices can be divided into two disjoint sets L and H, 
such that every link connects a vertex in L to one in H. Bipartite graphs are also known as two-colorable 
graphs since the vertices can be colored perfectly into two colors so that no two connected vertices are 
of the same color. Examples of bipartite graphs include tree graphs, cycle graphs and planar graphs with 
even degrees. In our analysis, we use the normalized form of the Laplacian matrix C = D^^/^LD^-*^/^ 
for the bipartite graph , which in the case of regular graphs has the same set of eigenvectors as L. 
The normalization reweighs the edges of graph G so that the degree of each node is equal to 1. To 
understand the spectral interpretation of DU operations in bipartite graphs, the following properties of 
bipartite graphs are useful: 

Lemma 1 ( ^17\ Lemma L8]): The following statements are equivalent for any graph G: 

1) G is bipartite with bipartitions H and L. 

2) The spectrum of £(G) is symmetric about 1 and the minimum and maximum eigenvalues of C{G) 
are and 2 respectively. 
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r 1 

3) If u = is an eigenvector of C with eigenvalue A with ui indexed on H and U2 indexed 

r 1 ^ 

on L (or vice-versa) then the deformed eigenvector u = is also an eigenvector of C 

with eigenvalue 2 — A. 
Based on these properties of bipartite graphs we state our key result below: 

Proposition 1: Given a bipartite graph G = {L,H,E) with Laplacian matrix C, if we choose down- 
sampling function /3 as or (3l as defined in and if Pa is the eigen-space corresponding to the 
eigenvalue A^ then 

J^Pa = P2-AJ/3- (22) 

Alternatively, if ua is an eigen- vector of C with eigenvalue A then Jpux is also an eigen- vector of C 
with eigen-value 2 — A. 

Proof: Let A be an eigenvalue of G with multiplicity k. This implies that there exists an orthogonal 
set of k eigenvectors {uj}A,=A of Laplacian matrix C with eigenvalue A. The projection matrix Pa 
corresponding to A is given by Pa = ^^^^^^Uj.u*. Note that in case of /c > 1, the eigenspace Pa 
is still unique whereas the eigenvectors {ui}A,=A are only unique up to a unitary transformation. If the 
downsampling function (3 is chosen as /3h or /3l, then the deformed eigenvector u in Lemma [T] is equal to 
J^u, which is an eigen-vector of C with eigen-value 2— A. It can also be seen that if eigenvectors {uj}A,=A 
are orthogonal to each other then so are the deformed set of eigenvectors {J^Ui}A,=A and form basis 
of eigenspace P2-a- Therefore, CJ/sPx^/B = EAi=A = Y.\;=x{^ - A).J/3Ui.(J/3Ui)* = 

(2 — A)P2_A, therefore J^PaJ/? = P2-A which implies that J^Pa = P2-aJ/3- ■ 
We term this phenomenon, spectrum folding in bipartite graphs, as the deformed eigenvector (or eigenspace) 
for any A G cr{G) appears as another eigenvector (or eigenspace) at a mirror eigenvalue around A = 1. 
To understand it, let f be an A^-D graph-signal on bipartite graph G = {L,H,E) with eigenspace 
decomposition 

f= PAf= (23) 

A6cr(G) AGa(G) 

where f'*' = PaT is the projection of f onto the eigenspace V\ and let the output signal after DU operation 
with downsampling function (3^ (or /?//) be frf„. Then the Vx eigenspace projection of the output signal 
is given as: 

fi = Pxfdu = 2 ^Af + Pa J& f , (24) 
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which using (22 1, can be written as: 



fi = ^PAf + J/3.P2-Af 

= l(fVJ^,f2-"). (25) 



In (25 1, the distortion term J^^f^^^, which arises due to the downsampling of f'*' has the same coefficients 
as that of f^^'^ (except for different signs). Further, the eigenspace decomposition of the output signal 
can be written as: 

fdu = l (f^ + J,3f'~^) = ^(f + f (26) 

AG(t(G) 

In other words, the output signal is the average of the original signal and a shifted and aliased version 
of the original signal, and hence the term spectral folding. In the next Section, we utilize this property 
to design perfect reconstruction filterbanks for bipartite graphs. 

B. Two-Channel Filterbank Conditions for Bipartite Graphs 

Referring again to Figure [TJ for bipartite graph G = {L,H,E), let Ph = /3 be the downsampling 
function for Hi filter channel and /3l = — be the downsampling function for Hq channel. Thus the 
nodes in H only retain the output of highpass channel and nodes in L retain the output of the lowpass 
channel. In our proposed design, we also choose the synthesis filters Gq and Gi to be spectral filters with 
kernels go{\) and 5'i(A) respectively |^ Then, by using ([sjl and (21 1 the perfect reconstruction conditions 



in ( [13] ) can be rewritten as: 

Teg = GqHo + GiHi 

= Yl (5o(A)/io(A)+5i(A)/ii(A))Pa 

T^alias = GiJ^Hi — GqJ^Ho 

= Y (5i(A)/ii(7)-5o(A)/io(7))PaJ/3P7- (27) 

A,7e(T(G) 

^In general, synthesis filters do not have to be based on the spectral design. A case is presented in our previous work jlSi 
with linear kernel spectral analysis filters and non-spectral synthesis filters. 
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1) Aliasing cancellation: Using (|5]l and the spectral folding property of bipartite graphs in ( p2] ), Taiias^ 
can be written as: 

Taiiasi = Yl (5i(A)/ii(2-A)-5o(A)/io(2-A))J;3P2-Af 
Ae(T(G) 

= (5i(A)/ii(2-A)-<7o(A)/io(2-A))PAJ^f2-^ (28) 

Ae(T(G) 

Since, J/3f^~^ is the aliasing term corresponding to f^, Taiias^ is the aliasing part of the reconstructed 
signal, and an alias-free reconstruction using spectral filters is possible if and only if for all A in cr{G), 

5o(A)/io(2 - A) - 5i(A)/ii(2 - A) = 0. (29) 

2) Perfect reconstruction: Perfect reconstruction means that the reconstructed signal f is the same as 
(or possibly a scaled version of) the input signal f . Tgg + alias = I- Therefore assuming the filterbanks 
cancel aliasing, the perfect reconstruction can be obtained if and only if Teg = c^I for some scalar 
constant c. Thus, a necessary and sufficient condition for perfect reconstruction, using spectral filters, in 
bipartite graphs filterbanks is that for all A in (t{G), 

go{X)ho{X) + gi{X)hi{X) = 
(7o(A)/io(2 - A) - gi{X)hi{2 - A) = 0. (30) 

3) Orthogonality: The equivalent analysis filter in the filterbank of Figure [T] is given as 

Ta = ^((I- J/?)Ho + (I + J/3)Hi) 

= ^(Ho + Hi) + ^J/3(Hi-Ho) (31) 

The filterbank provides an orthogonal decomposition of the graph signal if = T*, which implies 
TaT* = T*Ta = I. Since, the spectral filters as well as the downsampling matrix are symmetric, 
T* Tq can be expanded as: 

TiTa = ^ (Hg + H? + Hi J^jHi - H0J/3H0) (32) 
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Combining (21 1 and (32i we obtain: 



T*T, = 1/2 {hl{X) + hl{X)) Px 

Ae<7(G) ' 2^ ' 

+ 1/2 V {hi{X)h{2-X)-ho{X)ho{2-X))3^Px (33) 

V ' 

Ae<7(G) 21 

Thus, orthogonality can be obtained if and only if C\I + D\3p = c^I for some constant c and for all 
A G which is possible if and only if D\ = and C\ = (? for all A. Thus, a necessary and sufficient 

condition for orthogonality in bipartite graph filterbanks using spectral filters is : 

/io(A)/io(2 - A) - /ii(A)/ii(2 - A) = 

hl{X)^h\{X) = c2. (34) 



Note that, comparing ( [30| ) and (34i, the orthogonality conditions can be obtained from the perfect 
reconstruction conditions by selecting 50(A) = ho{X) and 51(A) = hi{X). This is analogous to the case 
of standard filterbanks and leads to our proposed graph-QMF design as explained in the next Section. 

C. Proposed Solution: Graph-QMF Design 

We extend the well-known quadrature mirror filter (QMF) solution to the case of bipartite graphs. 
Our proposed solution, termed as graph-QMF, leads to the design of a single spectral kernel /io(A) by 
selecting the other spectral kernels as: 

/11(A) = ^0(2 -A) 

50(A) = ho{X) (35) 
51(A) = /ii(A) = /io(2-A) 

Proposition 2 (QMF Filters on Graph): For a bipartite graph G = {L,H,E), let a two-channel fil- 
terbank be as shown in Figure [T] with the downsampling function /3 = (3h and with spectral filters 
{Ho, Hi, Go, Gi} corresponding to spectral kernels {/10(A), /ii(A), 50(A), 51(A)} respectively. Then for 
any arbitrary choice of kernel /io(A), the proposed graph-QMF solution cancels aliasing in the filterbank. 
In addition for /io(A)^ + /io(2 — A)^ = for all A G cr{G) and c / the filterbank provides perfect 
reconstruction and an orthogonal decomposition of graph-signals. 



Proof: Substituting (35 1 into (29 1 leads to 5o(A)/io(2 — A) — 5i(A)/ii(2 — A) = and aliasing is 



indeed canceled. The reconstructed signal x in this case is simply equal to (l/2)TeqX and can be written 
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as: 



i = 2 E {h\X) + hH2-X))^^ (36) 

Aea{G) 

Thus for (/i^(A) + /i^(2 — A)) = and c / 0, the reconstructed signal x = yx is a scaled version of 



original signal. Similarly applying the mirror design hi{X) = ho{2 — A) in the conditions (34i we get 
ho{X)ho{2 — A) — /ii(A)/ii(2 — A) = and /io(A) + /ii(A) = and hence corresponding analysis side 
transform Tq is orthogonal. ■ 
We now consider the design of kernels ho{X) satisfying the design constraint of Proposition |2j i.e., for 
which /io(A) + /io(2 — A) = for all A E cr{G). For maximum spectrum splitting in the two channels of 
the filterbank, the ideal choice of kernel ho{X) would be a lowpass rectangular function on A given as: 



h}f'"'\X) 



The corresponding ideal filter is given by 



c if A < 1 

c/7(2) ifA = l (37) 
if A > 1 



H^'^-' = ^cPa + ^Pa=i (38) 

A<1 

Note that the ideal transform has a non-analytic spectral kernel response with sharp peaks and is therefore 
a global transform (i.e., the filter operations are not localized). Even analytic solutions of the constraint 
equation /ig(A) + /iq(2 — A) = c^, such as /1.0(A) = cy'l — A/2 or /io(A) = c cos{ttX/A), are not very well 
localized in the spatial domain. By relaxing the constraints one can obtain spatially localized solutions 
at the cost of some small reconstruction error and near-perfect orthogonaUty. One such solution is the 
approximation of the desired kernel with a polynomial kernel. We choose polynomial approximations of 
the desired kernel due to the following localization property for corresponding transforms: 

Lemma 2 ([8]): Let /io(A) be a polynomial of degree k and let C be the normalized Laplacian matrix 
for any weighted graph G, then the matrix polynomial Hq = ho^C) is exactly A;-hop localized at each 
node of G. In other words for any two nodes n and m if m ^ Mkin) then Ho(n, m) = 0. 
Further, we choose a minimax polynomial approximation which minimizes the Chebychev norm (worst- 
case norm) of the reconstruction error since it has been shown in fSl that it also minimizes the upper- 
bound on the error \\}{^'^'^°'^ — H^°^y\\ between ideal and approximated filters. Thus, in order to localize 
the filters on the graph, we approximate /iq'^"' with the truncated Chebychev polynomials (which are a 
good approximation of minimax polynomials) of different orders. However since /i^''^"' is a rectangular 



December 5, 2011 



DRAFT 



19 



function it projects a lot of its energy in the truncated part of the polynomial expansions and as a 
result the polynomial approximation errors for /i^'^'^'^' are high. A possible solution of this problem is 
to soften the ideal case, by finding a smooth function that is low-pass and satisfies the constraint. An 
analogous construction in regular signal processing is Meyer's wavelet design which replaces the brick- 
wall type ideal frequency-response with a smooth scaling function that satisfies the orthogonality and 
scaling requirements. By a change in variable from uj £ [—1,1] to X £ [0,2] we can extend Meyer's 
wavelet construction in the case of bipartite graph. The construction involves choosing a function iy{x) 
such that v{X) = for A < , ^{X) = 1 for A > 1 and u{X) + z^(l — A) = 1 everywhere. One such 
function is given as: 



1 if A < 

3A2 - 2A3 if < a < 1 



(39) 







if 1 > A 



The smooth kernel is then given as: 



Meyer 




(A) 



K2--A) 



(40) 



In Figure ^a.), we plot the ideal and Meyer wavelet kernels and in Figures |2];b)-(f) we plot the recon- 
struction errors between desired kernels and their polynomial approximations of different orders. It can 




Fig. 2: (a) Ideal kernel (blue) vs. Meyer's wavelet kernel (red). It can be seen that Meyer's wavelet has smoother transition at 
A = 1 than the ideal kernel, (b)-(f) the reconstruction error magnitudes between original kernels and their polynomial 
approximations of order 2, 4, 6, 8 and 10 respectively: ideal kernel (blue curves) and Meyers kernel(red curve). 



be seen that Meyer's wavelet approximations yield small reconstruction errors as compared to ideal-filter 
approximations. Thus by choosing h{X) as the low-order polynomial approximations of smooth low-pass 
functions (such as Meyer's wavelets ), we obtain near perfect reconstruction QMF wavelet filters on any 
bipartite graph which are very well localized in spatial domain. 
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D. Multi-dimensional separable wavelet filterbanks for arbitrary graphs 

Not all graphs are bipartite. In order to apply our filterbank design to an arbitrary graph, G = (V, -B), 
we propose a separable downsampling and filtering approach, where our previously designed two-channel 
filterbanks are applied in a "cascaded" manner, by filtering along a series of bipartite subgraphs of the 
original graph. This is illustrated in Figure |3] We call this a "separable" approach in analogy to separable 
transforms for regular multidimensional signals. For example in the case of separable transforms for 
2D signals, filtering in one dimension (e.g., row-wise) is followed by filtering of the outputs along the 
second dimension (column-wise). In our proposed approach, a stage of filtering along one "dimension" 
corresponds to filtering using only those edges that belong to the corresponding bipartite subgraph. As 
shown in Figure [3} after filtering along one subgraph the results are stored in the vertices, and a new 
transform is applied to the resulting graph signals following the edges of the next level bipartite subgraph. 



ho ^Ul 



hi 1 



^h6^2i)"""-(i^3)H_gi 



A - Si 



Fig. 3: Block dia gram of a 2D Separable two-channel Filter Bank: the graph G is first decomposed into two bipailite subgraphs Bi and 
B2, using the proposed decomposition scheme. The first two-channel filterbank is designed on Si. The filtering and downsampling on Si 
creates output coefficients yu and y^, stored on the sets Hi and Li, respectively. The second filterbank is designed on S2, which operates 
separately on signals yu and y/, using the links of bipartite subgraphs B2{H\) and B2(L\) respectively. This creates 4 sets of output 
transform coefficients, denoted as y hh ,y HL^y LH and.y^^, which are stored at di.sjoint sets of nodes, given as 
Hi n H2, -ffi n L2, Li n H2 and Li n 1/2, respectively. 



In what follows we will assume that G has been decomposed into a series of K bipartite subgraphs 
Bi = (Lj, Hi, Ei), i = 1 . . . K; how such a decomposition may be obtained will be discussed later. The 
bipartite subgraphs cover the same vertex set: Li U Hi = V, i = 1,2, ...K. Each edge in G belongs to 
exactly one Ei, i.e., Ei n Ej = cp, i j, [j - Ei = E. Note that in each bipartition we need to decide both 
a 2-coloring {Hi, Li) and an assignment of edges {Ei). In order to guarantee invertibility for structures 
such as those of Figure [3} given the chosen 2-colorings {Hi, Li), the edge assignment has to be performed 
iteratively based on the order of the subgraphs. That is, edges for subgraph 1 are chosen first, then those 
for subgraph 2 are selected, and so on. The basic idea is that at each stage i all edges between vertices of 
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different colors that have not been assigned yet will be included in Ei. More formally, at stage i with sets 
Hi and Li, Ei contains all the links m E — ljfc=i that connect vertices in Lj to vertices in Hi. Thus 
El will contain all edges between Hi and Li. Then, we will assign to E2 all the links between nodes 
in H2 and L2 that were not already in Ei. This is also illustrated in Figure |4] Note that, by construction 
Gi = G — Bi = (V, E — El) contains now two disjoint graphs, since all edges between Li and Hi were 
assigned to Ei. Thus, at the second stage in Figure [3| B2 is composed of two disjoint graphs 62 (-^1) 
and B2{Hi), which each will be processed independently by one of the two filterbanks at this second 
stage. Clearly, this guarantees invertibility of the decomposition of Figure |3j since it will be possible to 
recover the signals in B2{Li) and B2{Hi) from the outputs of the 2nd stage of the decomposition. The 
same argument can be applied to the decompositions with more than two stages. That is, the output of 
a two-channel filterbank at level i leads to two subgraphs, one per channel, that are disconnected when 
considering the remaining edges {E — IJ^.^^ ^k)- The output of a i^-level decomposition leads to 2^ 
disconnected subgraphs. 



La Hi 




L. 



H2 



(a) (b) (c) 



Fig. 4! Example of 2-dimensional separable downsampling on a graph: (a) original graph G, (b) the first bipartite graph 
B\ = (Z/i, H\, El ). containing all the links in G between sets L\ and H\. (c) the second bipartite graph B2 = {L2, H2, Eg), containing 

all the links in G — Bi, between sets L2 and H2 



We now derive expressions for the proposed cascaded transform along bipartite subgraphs. Using 
K = 2 case as an example, assuming that the original graph can be approximated exactly with two 
bipartite subgraphs as shown in Figure [4| we choose /3j = /3//^ as the downsampling function for bipartite 
graph Bi, for i = 1,2. Further, let us denote 3(s^, as the downsampling matrices, and Hjo and Hji as the 
low -pass and high-pass graph-QMF filters respectively, for the bipartite graph Bi, for i = 1,2. Since, the 
vertex sets Li and Hi in bipartite graph B2 are disconnected, the filtering and downsampling operations 
on graphs B2{Li) and B2{Hi) do not interact with each other. Therefore, graph-filters tl2j, for j = 0,1 
on the second bipartite graph B2, can be represented as block-diagonal matrices with diagonal entries 
ii2j{Hi, Hi) and li2j{Li, Li). As a result, H20 and H21 commute with downsampling matrix of 
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the first bipartite subgraph, i.e., 

H2j J/3i = J/3iH2j, (41) 

for j = 1,2. [^Further, let Tai be the equivalent analysis transform for Bi, for z = 1,2. The combined 
analysis transform in the 2-dimensions can be written as the product of analysis transform in each 



dimension. Using (31 1, we obtain: 

2 



= T,2.T,i = 11^ ((H,i + Hio) + Jft(Hii - H,o)) , (42) 



Note that, for exact graph-QMF filter design such as with the Meyer kernel in ( |40) ), Taj is invertible with 
T^/ = T* ., for i = 0, 1. As a result, is invertible with T^^ = T*i.T^£] The transform function 
can be further decomposed into the transform functions Thh, T^hu T^lh and Tll corresponding to the 
four channels in Figure |3] For example, the transform Thh, consists of all the terms in the expansion 



of Ta in (42 1, containing filters Hn and H2i. Thus, 



'^HH = ^(H2iHii + H2iJ/3jHii + J^2H2iHii + J^2H2iJ/3iHii), (43) 

where (l/4)H2iHii is the transform without downsampling, and the remaining terms arise primarily due 
to the downsampling in the HH channel. Using ( [4T] ), which is a property of our proposed decomposition 
scheme in ( |43] ), we obtain: 

T^HH = ^(H2iHii + J^jH2iHii + J^2H2iHii + J^^H2iHii) 

= J(I + J^J(I + J^jH2iHn. (44) 

Thus, the equivalent transform in each channel of the proposed 2-dimensional separable filterbanks can 
be interpreted as filtering with a 2-dimensional filter, such as H21H11 for the HH channel, followed by 



DU operations with two downsampling functions /32(n) and /3i(n) in cascade. It also follows from (44i, 
that the output of H21H11 in the HH channel is stored only at the nodes corresponding to Hi n H2. 
Thus, the output of each channel is stored at mutually disjoint sets of nodes, and each node stores the 
output of exactly one of the channel. Therefore, the overall filterbank is critically sampled. Further, if the 
spectral decompositions of Bi and B2 are given as {A, P\} and {7, P^}, then H21H11 consists of a two 

''in general, this result can be applied to any general if -dimensional decomposition using proposed recursive method, as the 
downsampling matrix Jp^ commutes with all filter matrices H^i and Hfc2 corresponding to bipartite subgraph Bk, where k > i. 

^For polynomial approximations, of Meyer kernels, we incur some reconstruction errors in each dimension. 
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dimensional spectral kernel /i2i(7)^ii(-^) and corresponding eigenspace P^Pj^^- The analysis extends to 
any dimension K > 2 with K-dimensional graph-frequencies (Ai, A2, ...,Xk), corresponding eigenspace 
P\^,P\^, ■■■^Xk transforms with spectral response YliLi gii^i)- 

So far we have described, how to implement separable multi-dimensional graph-QMF filterbanks on a 
graph G, given a decomposition of G into K bipartite subgraphs. In particular, we defined a "separable" 
method of graph decomposition, which leads to a cascaded tree-structured implementation of the multi- 
dimensional filterbanks. While these multi-dimensional filterbanks can be implemented for any separable 
bipartite subgraph decomposition of G, the definition of a "good" bipartite decomposition of any arbitrary 
graph remains a topic for future work, and may be application dependent. In this paper, we propose 
a bipartite subgraph decomposition method, referred to as Harary's decomposition, which provides a 
\log2k^ bipartite decomposition of a graph G given a /c-coloring defined on ij^ The method is derived 
from |[T9]| and we describe it in Algorithm IF 



Algorithm 1 Harary's Decomposition 

Require: F, s.t. F{v) is the color assigned to node v, min(F)=l , max(F)=/c. 
1: Set Li = set of nodes with F{v) < [k/l] colors. 
2: Set Hi - set of nodes with F{v) > \k/2] colors. 
3: Set El C E containing all the edges between sets Hi and Li. 
4: Compute bipartite subgraph Bi = {Li, Hi, Ei), 
5: Set G = G-Bi. 

6: G is now a union of two disconnected subgraphs G{Hi) and G{Li). 
7: Graph G{Li) is [A;/2] -colorable. 

8: Compute coloring on G{Li) s.t. min{Fi,)-l , max(Fi,)=[A;/2]. 
9: Graph G{Hi) is [A;/2j -colorable. 

10: Compute coloring Yh on G{Hi) s.t. min(F//)=l , max(Fj^)= [A;/2j . 

11: Repeat 1 — 4 on G{Li) and G{Hi) to obtain bipartite subgraphs B2{Li) and B2{Hi). 

12: Compute bipartite subgraph B2 = 62(^1) U B2{Hi). 

13: Set G = G - B2. 

14: repeat 1 — 13 exactly [/og(2^1 times after which graph G will become an empty graph. 



Note that invertible cascaded transforms can also be constructed even when the conditions for edge 
selection described are not followed, e.g., if an edge ei between nodes in Hi and Li is not included in 
El. In such a situation, it is possible to perform an invertible cascaded decomposition if ei is no longer 
used in further stages of decomposition. Thus, we would have an invertible decomposition but on a graph 

*A graph is perfectly fc-colorable if its vertices can be assigned fc-colors in such a way that no two adjacent vertices share 
the same color. The term chromatic number x(G) of a graph refers to smallest such k. 

^Note that the bipartite decomposition is not unique and depends on the ordering in which the fc-colors are divided. 
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that approximates the original one (i.e., without considering ei). Alternatively it can be shown that it is 
possible to design invertible transforms with arbitrary Ei selections (i.e., not following the rules set out 
in this paper), but these transforms are not necessarily critically sampled. A more detailed study of this 
case falls outside of the scope of this paper. 



E. Multiresolution decomposition using two-channel filterbanks 

The two-channel filterbanks on a single bipartite graph B = {H, L, E) have the property of de- 



composing the signal into two lower-resolution versions and in respectively, as in (111. The signal 
is a lowpass or coarse resolution version constructed from the output coefficients of the lowpass 
channel stored on the set L, whereas is a highpass version of the input constructed from the output 
coefficients of the filterbank stored on the set H. Analogous to tree-structured filterbanks for 1-D signals, 
this decomposition can be applied recursively on the low-pass (or high-pass) signal by constructing a 
downsampled graph consisting of vertices in L (or H) and some appropriate edge-structure. One way to 
compute the downsampled graph Gl (or Gh) is to reconnect two nodes in set L (or H) if they are 2-hops 
away in the original graph. Note that for bipartite graphs, unlike the case of regular lattices, the resulting 
downsampled graphs Gl and Gh may neither be identical nor bipartite. Therefore, for the next level 
of decomposition, we can either operate on a single bipartite graph approximation of Gl which leads 
to a one-dimensional two-channel filterbank, or a multiple bipartite graph approximation, which leads 
to a multi-dimensional two-channel filterbank implementation on the downsampled graph. Further, this 
multiresolution decomposition of graph-signals can be extended to the case of general i^-dimensional 
two-channel filterbanks for any arbitrary graph G, which decomposes the signal into 2^ lower-resolution 



versions, as described in Section III-D In this case, the downsampled graphs in each channel, can be 
computed by reconnecting two nodes in the downsampled vertex set, if they are 2^-hops away in the 
original graph. 

IV. Experiments 

A. Graph-QMF Design Details 

We first provide explicit details of the filterbank design for arbitrary graphs. Given any arbitrary 
undirected graph G = {V,E), we find a minimum perfect-coloring x of its vertices using a graph- 
coloring algorithm, such as the BSC algorithm given in E0T|. The coloring information is then used to 
decompose G into a set oi K = \log2{x)'\ bipartite graphs Bi = {Li, Hi, Ei), for i = 1,2,. ..K using 



Harary's Algorithm as described in Section |III-D For each subgraph Bi, we compute its normalized 
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Laplacian matrix C\ and the downsampling function /3j = f^Hi ■ Further, we compute the low -pass analysis 
kernel /ii,o(A) on Bi, as the mf^ order Chebychev approximation of the Meyer kernel h^^^^'^^X), for 
some positive integer value mj. The remaining spectral kernels hi i{\),gifi{\),gi^i{\) are computed from 



hifl{\) according to graph-QMF relations mentioned in (35 1. The corresponding analysis and synthesis 
transforms are then computed as Hjj = hj{C\) and Gjj = gj{C\), respectively, for j = 0,1. Note 
that, since the kernels are polynomials, the transforms are also matrix polynomials of Laplacian matrices 
and do not require explicit eigenspace decompositions. In our experiments, we use mi = m, and hence 
hij{X) = hj{X), j G {0, 1} for all i, in which case the resulting transforms are exactly m-hop localized 
on each bipartite subgraph. The order m is a parameter of our design and should be chosen based 
on the required level of spatial localization and how much reconstruction error can be tolerated. The 
overall filterbank is designed by concatenating filterbanks of each bipartite subgraph in the form of a 
tree, analogous to Figure [3] in the 2-dimensional decomposition case. We now describe some experiments 
to demonstrate potential applications of our proposed filterbanks. 

B. Graph Filter-banks on Images 

Digital images are 2-D regular signals, but they can also be formulated as graphs by connecting every 
pixel (node) in an image with its neighboring pixels (nodes) and by interpreting pixel values as the 
values of the graph-signal at each node. The graph-representations of the regular-signals are shown to be 
promising in practice recently lIlTI . ll22l . Figure |5] shows some of the ways in which pixels in an image can 
be connected with each other to formulate a graph representation of any image. The advantage of using a 
graph formulation of the images is that it provides flexibility of linking pixels in arbitrary ways, leading to 
different filtering/downsampling patterns. To demonstrate this, we implement an ideal spectral low-pass 




Fig. 5: Some of the graph-formulation of a 2D image lattice: (a) shows an 8-connected image graph G formed by connecting 

each pixel with its 8 nearest neighbors. The graph is 4-colorable, and the nodes of different shapes (squares,circles,triangles 
and diamonds) represent different colors, (b) shows the image-graph G" by connecting each pixel with its rectangular (NWSE) 
neighbors only, (c) the image graph with vertical links only (d) the image-graph G^ with horizontal links only, and (e) 
shows image-graph with each pixel linked to its 4 diagonal neighbors The graphs shown in (b), (c), (d) and (e) are 
bipartite graphs, with the partitions represented as nodes with different colors and shapes (red-circles vs. blue-squares). 
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(a) (b) (c) 



Fig. 6: Discrete Fourier frequency magnitude responses of ideal lowpass filters on some bipartite image-graphs. Fig. (a) ideal 

lowpass filter response on NWSE bipartite subgraph shown in [5]), Fig. (b) ideal lowpass filter response on diagonally 
connected bipartite subgraph shown in [5]:, Fig. (c) ideal lowpass filter on vertical-links only bipartite subgraph shown in 
[5]i, Fig. (d) ideal lowpass filter on horizontal-links only bipartite subgraph shown inBfe. 



filters on the graph formulations of the 2D images, shown in Figure [s] Since, the graphs , G", and 
are all bipartite graphs, the ideal spectral lowpass filter iP^'^"-'- on these graph can be computed as 
in ( [38] ). In Figure [6} we plot the DfT magnitude response of ideal lowpass spectral transforms on bipartite 
image-graphs C, G", and G'^ respectivelyj^In Figure |5|b) the downsampling pattern (red/blue nodes) 
on the rectangular subgraph G^ is identical to the quincunx downsampling pattern, and in Figure |6ja), 
it can be observed that the DFT magnitude response of the spectral low-pass filter on G^' is same as the 
DFT magnitude response of the standard anti-aliasing filter for quincunx downsampling. Similarly, we 
observe that the spectral low-pass filters for G"" in Figure [sjc) and G'^ in Figure jsjd) have the same DFT 
magnitude responses (Figure [6jb) and |6jc)) as the anti-aliasing filters for vertical and horizontal factor- 
of-2 downsampling cases, respectively. Further, the graph formulation of images allows us to explore 
new downsampling patters, for example, the image pixels can be connected to their diagonally opposite 
neighbors as shown in Figure ^e,). The DFT magnitude response of the ideal spectral low-pass filter 
in this case, is shown in Figure [6]^d) and has a wider passband in the diagonal directions. Further, in 
the non-bipartite graph formulation of the anti-aliasing filter for any arbitrary graph is the product of 
ideal-lowpass filters along its bipartite subgraph decompositions. Therefore the rectangular graph G"" 
can be further decomposed into bipartite subgraph G^ and G^ leading to a rectangular (factor of 4) 
downsampling pattern. 

This graph-based approach also provides additional degrees of freedom (directions) to filter/downsample 
the image while still having a critically sampled output. To demonstrate this, we implement a graph 
wavelet filterbank on the 8-connected image-graph G of a given image. The chromaticity of G is x = 4 

^Because of the regularity and symmetry of the links, the resulting filters at each node, are translated version of each other 
(except at the boundary nodes), and so we can compute the 2-D DFT magnitude response of a spectral transform, by computing 
the DFT response of the filtering operations at a single node. 



December 5, 2011 



DRAFT 



27 



(represented as different shape nodes in Figure |5ja)) and hence it can be decomposed into two edge- 
disjoint bipartite subgraphs. Among several such possible decompositions, we choose the decomposition 
that gives us a rectangular subgraph and a diagonally connected diamond graph C^. On each subgraph 



we implement a graph-QMF filterbank, as described in Section IV-A above. The resulting 2-dim separable 
filterbank has four channels as shown in Figure [3] and the nodes representing a specific shape in Figure [5ja) 
store the output of a specific channel]^ Figure [v] shows the output wavelet coefficients of proposed 2-dim 
filterbank on a toy image which has both diagonal and rectangular edges. In Figure|7j the energy of wavelet 
coefficients in the LH channel (low-pass on G^, high-pass on G'^) is high around the rectangular edges, 
which is reasonable, since subgraph G'^ is diagonally connected and its low-pass spectral frequencies 
are oriented along diagonal links. Similarly we observe that the high-energy wavelet coefficients in the 
HL channel (high-pass on C, low-pass on G'^) lie around the diagonal edges, since C is rectangularly 
connected and its low-pass spectral frequencies are oriented towards horizontal and vertical directions. 
This example also shows that the filterbanks based on only NWSE connectivity are more suited for 
images with horizontal and vertical edges whereas the transform based only on diamond connectivity 
are more suited for image with diagonal edges. In Figure [8] we show the graph-wavelet decomposition 
of a depth- map image taken from [12311 . Again, we see that the LH channel has high energy coefficients 
along nearly rectangular edges while the HL channel has high energy coefficients along nearly diagonal 
directions. More directions can be added to downsample/filter by increasing the connectivity of the pixels 
in the image-graph. Moreover, since graph-based transforms operate only over the links between nodes, 
the graph formulation is useful in designing edge-aware transforms, such as EU, |[22]| . (which avoid 
filtering across edges) by removing links between pixels across edges. 

C. Graph Filter-banks on Irregular Graphs 

Our proposed filterbanks can be used as a useful tool in analyzing/compressing arbitrarily linked 
irregular graphs. In order to demonstrate it we take the example of Minnesota traffic graph G as shown 
in Figure |9ja). Further, we consider the decomposition of a graph-signal whose scatter-plot is shown in 
Figure |9jb), using our proposed filterbanks on graph. The graph is perfectly 3-colorable and hence, we 



can decompose it into [/o52(3)] = 2 bipartite subgraphs Bi and B2 which are shown in Figure 10 a) 
and [TOf b) respectively. 

*In general for an arbitrary graph with if-proper colors, the bipartite decomposition provides exactly K non-empty channels 
and nodes of a particular color store the output of a particular channel. 
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Fig. 7: Separable two-dim two channel graph filterbank on a toy image with both rectangular and diagonal edges. The 
filterbank is the concatenation of proposed graph-QMF filterbank with m = 2 order approximation of Meyer kernel on 

subgraph and subgraph G"* as shown in Figure 3 





Fig. 8 1 Separable two-dim two channel graph filterbank on a depth-map image with parameter to = 6 



Given such decomposition, we implement a 2-dim separable 2-channel graph-QMF filterbank on the 



Minnesota graph, with parameter value m = 6, according to the details given in Section IV-A Since the 
proper coloring of graph G is 3, there are no nodes to sample HL channel output (i.e. nodes for which 
(/3i(n), /32(ra)) = (—1, 1)) and hence there are only three non-empty channels (LL, LH, HH). Figure 11 
shows the output wavelet coefficients. The HL channel is empty and is not displayed in the results. 
Due to downsampling, the total number of output coefficients in the four channel is equal to number of 



input samples, thus making the transform critically sampled. We observe in Figure 11 that for the LL 



channel (/3i(n), /32(ra)) = (1, 1), the signal on the downsampled graph is a smooth approximation of the 
original signal (sharp boundaries blurred). The remaining channels store the detail information required 
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1st Bipartite Graph 2nd Bipartite Graph 




431 1 i 1 1 1 1 1 i 1 43 1 , , , , , , , , 1 

-98 -97 -96 -95 -94 -93 -92 -91 -90 -89 -98 -97 -98 -95 -94 -93 -92 -91 -90 -89 



Fig. 10: Bipartite decomposition of Minnesota graph into two bipartite subgraphs using Harary's decomposition. 



to perfectly reconstruction, original graph signal from its smooth approximation. In order to see how 
much energy of the original signal is captured in each channel, we upsample then filter the coefficient of 
each channel by the synthesis part of proposed filterbank. Figure [12] shows the output of each of the four 
channel after upsampling/filtering. We see in these plots, that Figure [T2jb) is an approximation of the 
original signal, while Figure 12 c), and Figure [T2|^d) are the details required to reconstruct the original 



signal from the approximation. 



V. Conclusion and Future Work 



We have proposed the construction of critically sampled wavelet filterbanks for analyzing graph-signals 
defined on any arbitrary finite weighted graph. For this we have formulated a bipartite subgraph decom- 
position problem which produces an edge-disjoint collection of bipartite subgraphs. For these bipartite 
graphs we have described and proved a spectrum folding phenomenon which occurs in downsampling 
then upsampling {DU) operations and produces aliasing in the graph signals. Based on this result, we 
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Original Graph Signal LL Channel Coeffs 




-98 -96 -94 -92 -90 -88 -98 -96 -94 -92 -90 -88 



LH Channel Coeffs HH Channel Coeffs 




-98 -96 -94 -92 -90 -88 -98 -96 -94 -92 -90 -88 



Fig. 1 1 : The Delaunay triangulation plots of output wavelet coefficients of tlie proposed filterbanks with parameter m = 6. 
The edge-color reflects the value of the coefficients at that point, (a) original graph signal (b) LL channel wavelet coefficients 
(c) LH channel wavelet coefficients (d) HH channel wavelet coefficients 

have proposed two-channel wavelet filterbanks on bipartite graphs and provided necessary and sufficient 
conditions for aliasing cancellation, perfect reconstruction and orthogonality in these filterbanks. As a 
practical solution, we have proposed a graph-QMF design for bipartite graphs which has all the above 
mentioned features. The filterbanks are however, realized by Chebychev polynomial approximations at 
the cost of small reconstruction error and loss of orthogonality. Our current efforts are focused on finding 
solutions other than the proposed graph-QMF design and to understand and differentiate 'good' and 'bad' 
decompositions of arbitrary graphs into bipartite subgraphs. 
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Original Graph Signal LL Channel 




Fig. 12: The Delaunay triangulation plots of the reconstructed graph-signals using the coefficients of a single channel. As 
before the edge-color reflects the value of the coefficients at that point, (a) original graph-signal (b) reconstruction with LL 
channel coefficients only (c) reconstruction with LH channel coefficients only (d) reconstruction with HH channel coefficients 

only 
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